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Abstract. We prove a version of the Chevalley Restriction Theorem for the action of a real 
reductive group G on a topological space X which locally embeds into a holomorphic represen- 
tation. Assuming that there exists an appropriate quotient X//G for the G-action, we introduce 
a stratification which is defined with respect to orbit types of closed orbits. Our main result is 
a description of the quotient X//G in terms of quotients by normalizer subgroups associated to 
the stratification. 



1. Introduction 

Let G be a connected complex semisimple Lie group and let us consider the adjoint repre- 
sentation of G on its Lie algebra q. If f) is a Cartan subalgebra of g, then the inclusion f) 
induces a homomorphism of the algebra C[q\ of polynomials on g into the algebra C[t)] of poly- 
nomials on [). Let C[g]*^ denote the set of invariant polynomials on q with respect to the adjoint 
action of G on g. If W is the Weyl group of g with respect to f), we denote by C[f)]^ the set of 
W-invariant polynomials on f). The Chevalley restriction theorem states 

(Chevalley) The inclusion f) ^ g induces an isomorphism C[g]'^ — > C[f)]^. 

In terms of algebraic quotients this means that we have a canonical isomorphism f) / W — > g //G 
of algebraic varieties. 

The Chevalley restriction theorem was generalized by Luna and Richardson ([LR79]) and by 
Schwarz ([SchSO]) to actions of complex reductive groups on affine varieties and to actions of 
compact groups on smooth manifolds, respectively. 

Assume that X is an irreducible normal affine variety equipped with a regular action of a 
complex reductive group and denote by tt: X ^ ^//G the algebraic quotient. Then there exists 
a Zariski open subset U oi X and a subgroup H oi G such that each fiber of the restricted 
quotient U — > U//G contains a closed orbit of orbit type G/H. Let X^ be the set of ff-fixed 
points in X and let Mg{H) be the normalizer of H in G. 

(Luna, Richardson) Assume that the quotient X^ //Mg{H) is irreducible. Then the inclusion 
X^ ^ X induces an isomorphism X^ //Ng{H) X//G of affine varieties. 

Let G be compact and let X be a smooth G-manifold such that the quotient X/G is connected. 
Then there exists a generic isotropy group, i. e. a subgroup H oi G such that in a G-invariant 
dense open subset of X each orbit is of orbit type G/H. Let X'^^^ := {x G X; Gx = H} and 
let X<^> denote the closure of X<^> . 



(Schwarz) The inclusion ^ X induces a homeomorphism X'^^^ /MciH) X/G. 

We give a version of the Chevalley Restriction Theorem for actions of real reductive groups 
on topological spaces which are locally embedded into representations. 
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More precisely our setup is as follows. Let U be a complex reductive group with compact 
real form U. Then the map U x iu ^ U'^, (u,^) nexp(,^), is a diffeomorphism. We call a 
closed subgroup G of C/^ real reductive, if G = K exp{p) for K := G (lU and p := g n iu. 

If X is a G-representation which is given by restriction of a finite dimensional holomorphic 
?7'^-representation, then the topological Hilbert quotient vr: X — > X//G exists. By definition, 
this quotient identifies two points in X if and only if the closures of the G-orbits through these 
points intersect. For a subset Y C X which is G-saturated, i. e. for which 7r~^(7r(y)) = Y holds, 
or which is closed and G-invariant, the quotient Y — > Y//G exists and is given by the restriction 
■k\Y : y — > vr(y). We call a topological G-space X a locally G-semistable space, if the topological 
Hilbert quotient vr: X — > X//G exists, and if for each x X there exists a G-saturated open 
neighborhood W of x and a complex reductive group U'^ containing G as a closed compatible 
subgroup such that W is G-equivariantly homeomorphic to a closed G-invariant subset of an 
open G-saturated subset of a holomorphic [/"^-representation space V. 

If X is a locally G-semistable space and G-x is a closed orbit in X, then there exists a geometric 
G-slice at x as follows. Let Gx be the G-isotropy group at x and let be a G^^-invariant locally 
closed subset of X which contains x. Then Gx acts on G x S" by /i • ((7, s) = {gh~^ , h ■ s) and the 
restricted action G x S ^ X , {g,s) g ■ s induces a map ^ : G x'^^ S ^ GS where G x*^^ 
denotes the quotient (G x S)/Gx- We call S a geometric G-slice, if \I' is a homeomorphism onto 
an open subset. Here it follows from the construction that the slice S can be chosen such that 
GS is G-saturated and S" is a locally G^-semistable space. 

For a locally G-semistable space X, each fiber of the quotient ir: X ^ X//G contains a unique 
closed orbit and this orbit is also the unique orbit of minimal dimension in that fiber. For a 
compatible subgroup H of G, we define X^^^ to be the set of points x £ X such that G • x is 
closed and Gx = H. We call Ih{X) := 7r-^(7r(X<-^>)) the G-isotropy stratum of H in X. One 
of our results is that the sets Ih{X) define a stratification of X. 

If G is complex reductive and acts regularly on an irreducible complex space, then there exists 
a dense stratum. This is also the case if G is compact and X is a smooth G-manifold such that 
the quotient X/G is connected. For actions of real reductive groups, the stratification is more 
delicate. Even if X is a G-representation space, a dense stratum does not necessarily exist. 
Originally we were interested in actions on smooth manifolds but the fact that strata are not 
smooth in general motivated our definition of a locally G-semistable space. Here a stratum in 
X and even the closure of a stratum are again locally G-semistable spaces and they contain a 
dense stratum. 

In the following, we assume that the locally G-semistable space X contains a dense stratum. 
Let xq € X and let G • x be the unique closed orbit in the fiber 7r~^(7r(xo)). Let G x*^^ S — > GS 
be a slice at x. Since 5" is a locally G^-semistable space, we have the notion of G^^-isotropy 
strata in S. We define n(xo) to be the number of open G^^-isotropy strata in S which contain x 
in their closure and we call n(xo) the splitting number at xq. Note that the splitting number is 
one in the simple cases where the existence of a dense stratum is guaranteed. 

Our main result is the following. 

Restriction Theorem. Let X he a locally G-semistable space containing an open and dense 
G-isotropy stratum Ih{X). Then the topological Hilbert quotient ttn'- X<^> — > X<^> //MciH) 
exists and the inclusion X<^> ^ X induces a continuous finite surjective map 



X<^>//Ng{H) ^ X//G. 

For X € X, the number of points in the fiber $~^(7r(x)) is equal to the splitting number n(x). // 
X G X<^> with n(x) > 1, then ^> is not open at 7rAr(x). 
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Here by a finite map, we mean a proper map with finite fibers. In the special case where 
the sphtting number is constantly one, the map $ is a homeomorphism. The splitting number 
is one for points in the stratum Ih{X) and Ih{X) is again a locally G-semistable space, so in 
particular the restriction X'^^^ //MciH) — > Ih{X)//G of <I> is a homeomorphism. 

Our result is new even for a representation of a semisimple real group or more generally if X is 
a G-representation space which is given by restriction of a holomorphic [/^-representation. If the 
representation space X contains a dense stratum, then X<^> is the subspace of H-fixed points 
in X. In particular X<^> is smooth. This holds also if X is a smooth locally G-semistable 
space containing a dense stratum. 

If G is complex reductive and if X is a holomorphic G-representation, a dense stratum always 
exists and the splitting number is constantly one. Consider the adjoint representation of the 
complex reductive group G on its Lie algebra X = q. Here X<^> is a Cartan subalgebra f) of 
0. The group H acts trivially on t), so the quotient X<^> //AfciH) coincides with the geometric 
quotient f)/W where W = Ng[H)/H is the Weyl group. Thus we get the assertion of the 
Chevalley restriction theorem. For the adjoint representation of a real reductive group, a dense 
stratum does not necessarily exist. But for each open stratum Ih{q), the Lie algebra f) is a real 
Cartan subalgebra. So, restricting the quotient q//G to Inid) we get a version of the Chevalley 
restriction theorem for the adjoint representation of a real reductive group. 

If X is an irreducible normal variety equipped with a regular action of a complex reductive 
group G then a dense stratum exists and the splitting number is constantly one. Due to normality 
of X, the map <I> is an isomorphism of varieties. If the quotient X^ //Mg{H) is irreducible then 
it coincides with X^^^ // Mg{H) and we obtain the theorem of Luna and Richardson where it 
is assumed that X^ //Ng{H) is irreducible. 

If G is compact and X is smooth, then the condition that X/G is connected guarantees that 
there exists a dense stratum in X. Moreover the splitting number is constantly one, so we obtain 
the result of Schwarz. 

The author would like to thank P. Heinzner and G. Schwarz for helpful discussions and remarks 
on the content of this paper. 

2. Locally semistable spaces 

2.1. Real reductive groups. Let U'^ be a complex reductive Lie group with compact real 
form U . If u denotes the Lie algebra of U , then U'^ = U exp(iu). Here the map ?7 x iu — > C/^, 
{u,^) ^ nexp(,^) is a diffeomorphism. Note that U'^ is the universal complexification of U in 
the sense of [Ho65]. We denote by 9 the Cartan involution with fixed point set U. 

We say that a Lie subgroup G of C/*^ is compatible, if G = /^exp(p) for a subgroup K oi U 
and a subspace p of iu. A ^-stable closed subgroup of U'^ is compatible if and only if it has only 
finitely many connected components (see e.g. Lemma 1.1.3 in [Mie07]). We call G = K ex.p{p) 
the Cartan decomposition of G. Note that K is compact if and only if G is closed. Moreover, we 
call a Lie subgroup H of G compatible if it is compatible with the Cartan decomposition of U'^ 
or equivalently, if there exists a subgroup L of K and a subspace q of p such that H = Lexp(q). 
Note that the latter condition depends only on the Cartan decomposition of G and not on the 
choice of U'^. In the rest of this paper, G will denote a closed compatible subgroup of a fixed 
complex reductive group Uq and G = Xexp(p) will denote the associated Cartan decomposition 
of G. 

2.2. The topological Hilbert quotient. Let X be a topological G-space, i.e. a topological 
space equipped with a continuous action of G. We define a relation on X by setting a; ~ y if 
and only if the closures G • x and G ■ y of the orbits G • x and G • y intersect. If this relation 
is an equivalence relation, we define X//G := X/ ~ and call the quotient tt: X — > X//G the 
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topological Hilhert quotient. If every G-orbit in X is closed, in particular if G acts properly on 
X, then the quotient X//G is the usual orbit space X/G. This happens automatically if G is 
compact. 

Assume that the topological Hilbert quotient X — > X//G exists. A subset y C X is called 
G-saturated, if y = 7r~"'^(7r(y)) holds, or equivalently, if x ^ Y whenever there exists a y G Y 
with G ■ X G ■ y ^ 0. We say that a subset y of X is G-open if it is open and G-saturated. 
Furthermore, we call a subset y of X a G-locally closed subset, if the following equivalent 
conditions are satisfied. 

• y is a G-invariant closed subset of a G-open subset of X. 

• y is the intersection of a G-open and a closed G-invariant subset of X. 

• y is G-invariant, locally closed, and an orbit G • y C y is closed in Y if and only if it is 
closed in X. 

For a G-locally closed subset y of X the quotient Y Y//G exists and is obtained by restriction 
of the quotient X X//G. 

2.3. Semistable spaces. Recall that G is a compatible subgroup of a complex reductive group 
{Ug)^ with Cartan involution 6. Let p: G ^ GhiV) be a representation of G on a finite 
dimensional complex vector space V such that poO = 9' o p for a Cartan involution 9' of GL(y). 
Equivalently, we assume that we are given a complex reductive group U'^ which contains G as 
a compatible subgroup and a holomorphic representation p: U'^ — > GL{V). For this, note that 
U'^ := (Ug)'^ X GL{V) is complex reductive and that the map g i-^ {g,p{g)) embeds G into U'^ 
and respects the Cartan decomposition. Conversely, given a holomorphic representation of a 
complex reductive group U'^, there exists a Cartan involution 9' of GL{V) which contains the 
compact group p{U) in its fixed point set. 

We may assume that U acts by unitary operators on V by choosing a [/-invariant hermitian 
inner product (•,•) on V. Let /: F — > M, f{v) = := ^{v,v). Then / is a [/-invariant 

strictly plurisubharmonic exhaustion function on V and we get an induced [/-invariant Kahler 
form u> := 2iddf. The [/-action on V admits a moment map, i. e. a [/-equivariant map fi: V ^ u* 
with dfi^ = t^yOO. Here U acts on u* by the coadjoint action, p,^ is by definition the function 

p^(v) = p{v){^), the fundamental vector field is given by Cviv) = -§t q Pi^^Pi'tC))^ and is 
the contraction of to with ^y. Explicitly, a moment map is given by 



/(exp(itO • v) = i{£,v{v),v), 





where we identify T„y with V. 

Identifying u* and iu with respect to a [/-invariant inner product (•, •) on u^, the moment 
map induces by restriction a map ppi V ^ p, given by {pp{v),^) := Pp{v) := p~^^{v). Then 
is X-equivariant and satisfies the defining equation grad pp = £,v where the gradient is taken 
with respect to the Riemannian metric on V associated to the Kahler metric. Therefore we call 
Pp a G-gradient map. 

We call a G-invariant locally closed subset XoiVa G-semistable space if each G-orbit which 
is closed in X is also closed in y. In the following we consider the restriction : X — > p of the 
gradient map to X. Define Aip to be the zero fiber pp^{0) C X. 

The following results are established in [RS90] and [HSOTb]. 

Theorem 2.1. The topological Hilbert quotient vr: X — > X//G exists and has the following 
properties. 

(1) Each fiber of it contains a unique closed G-orbit. 
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(2) Each non-closed orbit in a fiber of vr has strictly larger dimension than the closed orbit 
in that fiber and contains the closed orbit in its closure. 

(3) For X G A4p the orbit G ■ x is the unique closed orbit in the fiber 'k~'^{t^{x)). 

(4) The inclusion ^ X induces a homeomorphism A4p/K X//G. 



Mp/K X//G 

(5) The restriction 7r|Alp of the quotient map is proper and open. 

In particular, the theorem states that the orbits which intersect A4p are exactly the closed or- 
bits and that A4p intersects each closed orbit in a i^'-orbit. So the quotient Aip/K parameterizes 
the closed G-orbits in X. 

Remark. Note that in particular the quotient V — V//G exists. Then X C ^ is a G-semistable 
space if and only if it is G- locally closed in V. 

For later use we record 

Corollary 2.2. LetY C X be G-locally closed. Then YTUA^ = F n A^p. 

Proof. Let x € y n A^p and let G ^ be a sequence converging to x. Then there exist 
y-n ^ G ■ x^T] A^p. Note that y„ G y since Y is G-locally closed. The sequence 7r(y„) = 7r(x„) 
converges to 7r(x). Since the restriction of vr to Alp is proper, we may assume that y„ converges 
to a y € Alp. Then y G Y and 7r(y) = 7r(x). Since 7r~"'^(7r(a;)) fl A4p is a i^T-orbit we conclude 
x e K -y c y n A^p. □ 

Corollary 2.3. Let G ■ x C X be a closed orbit. Then every G-invariant open neighborhood of 
G ■ X contains a G-open neighborhood. 

Proof. Let be a G-invariant open neighborhood of G-x. The set 7r~^(7r(VFn A^p)) is G-open, 
contains G • x and is contained in W. □ 

If if is a closed compatible subgroup of G then it follows from the definition that a G- 
semistable space is also an i?-semistable space. Compatible subgroups of G occur naturally as 
isotropy groups of closed orbits. 

Lemma 2.4. (Lemma 5.5 in [HS07b]j Let X be a G-semistable space and let x £ Alp. Then 
the isotropy group Gx is a closed compatible subgroup of G with Cartan decomposition Gx = 
Kxex.v{'?x) where ^x ■= G P; Cxix) = 0}. 

2.4. The Slice Theorem. Let X C V he a G-semistable space. From [HSOTb] we recall the 
construction of a slice at a point x G A4p in the case X = V. First, the action of G on X induces 
an isotropy representation of Gx on the tangent space TxX. Then TxX can be G^-equivariantly 
identified with X. Note that TxX is a G^-semistable space since Gx is a compatible subgroup 
of G. The tangent space Tx{G ■ x) of the orbit G • x is a Ga;-invariant subspace of TxX. 

Lemma 2.5 (Corollary 14.9 in [HSOTb]). The G -representation V is completely reducible. 

Since Gx is compatible, V = TxX is completely reducible as a G^-representation. Therefore 
there exists a Ga;-invariant subspace W of TxX such that TxX = Tx{G ■ x) © W. The isotropy 
Gx acts on the product G x W hy h ■ {g, s) = {gh~^ , hs). We denote the quotient of this action 
by G x*^^ and we denote the element Gx ■ {g,s) by [g,s]. The action of G on X induces a 
map G x*^^ — > GW C X. There exists a Ga;-invariant neighborhood of in 1^ such that 
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the restriction G x'-'^ S" — > GS is a diffeomorphism onto an open subset GS of X. Moreover, by 
Corollary 2.3, S can be chosen such that GS is G-saturated in X and S is G^-open in T^X. In 
particular, 5 is a Gx-semistable space. 

Similarly, for an arbitrary G-semistable space X we get ([St08], Corollary 4.5, Lemma 4.9) 

Theorem 2.6 (Slice Theorem). Let X be a G-semistable space and let x G Alp. Then there 
exists a locally closed Gx-stahle subset S of X containing x, such that GS is G-open in X and 
such that the map 

m-.Gx''- S^GS, ^{[g,s])=gs 

is a homeomorphism. The slice S is Gx-equivariantly homeomorphic to a Gx-locally closed subset 
ofTxV = V which contains 0. 

With the same notation as in the Slice Theorem, we call the data {Gx, S, V) a slice model at 
X. We will identify S C X with the corresponding G^^^-locally closed subset of V without further 
mentioning it. Let {Gx,S,V) be a slice model at x G A^p and g G G. Then Ggx = gGxg~^ 
and g ■ S contains gx. Then we get a homeomorphism G x*^""^ gS GS. This shows that the 
assumption x € A4p could be replaced by the assumption that G • x is closed. Note that Ggx is 
not necessarily a compatible subgroup of G. 

2.5. Locally semistable spaces. Let X be a topological G-space such that the topological 
Hilbert quotient tt: X ^ ^//G exists. We call X a locally G-semistable space if every x G X 
has a G-open neighborhood W which admits the structure of a G-semistable space, i. e. there 
exists a complex reductive group ^7*^ containing G as a compatible subgroup and a holomorphic 
-representation space such that W is G-equivariantly homeomorphic to a G-locally closed 
subset of V. 

Example 2.7. Let X be an affine complex variety equipped with a regular action of a complex 
reductive group G such that the algebraic Hilbert quotient exists. Then the topological Hilbert 
quotient exists and topologically coincides with the algebraic quotient. Moreover, X can be 
G-equivariantly embedded into a regular G-representation, so X is a G-semistable space. More 
generally, if X is an arbitrary complex variety, such that the good quotient (see [BCM02]) exists, 
then X is a locally G-semistable space. 

Similarly, a complex space with a holomorphic action of a complex reductive group G such 
that the analytic Hilbert quotient exists, is a locally G-semistable space. Here this follows from 
[Sn82]. 

Lemma 2.8. Let X be a locally G-semistable space and let Li be a closed compatible subgroup 
of G. Then X is a locally LL -semistable space. 

Proof. If X is a G-semistable space, then it follows from the definition that it is also an L{- 
semistable space. In particular, the quotient with respect to the action of H exists. Since a 
locally G-semistable space X is covered by G-open subsets which are G-semistable spaces, it 
follows that the quotient X — > X// LI exists. Since a G-saturated subset is also i?-saturated, the 
claim follows. □ 

The notion of the zero fiber of a gradient map does not make sense for a locally G-semistable 
space. As a substitute, we define Xcc C A to be the set of points x G A such that G • x is closed 
and such that Gx is compatible. For a G-semistable space we have Alp C Xcc- In particular, in a 
locally G-semistable space each closed G-orbit intersects Xcc since it has a neighborhood which 
is a G-semistable space. Conversely for a locally G-semistable space A and an x G Xcc there 
exists a G-saturated open neighborhood of x which is a G-semistable space such that x G A(p. 
For this, we first observe that there exists a slice model [Gx, S, V) at x £ Xcc since by definition 
there exists a G-open neighborhood of x which admits the structure of a G-semistable space 
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containing G ■ x as a closed orbit. In particular the G-action on this neighborhood is given by 
restriction of a holomorphic [/''-representation, where U'^ is complex reductive and contains G 
as a compatible subgroup. The complex analytic Zariski closure G^ of Gx in U'^ is compatible, 
contains Gx and is contained in {U'^)x- Therefore G R G^ = Gx- Since y is a holomorphic G^- 
representation space, we get an embedding G x^"^ S U'^ x*^^ V. By Lemma 1.16 in [Sj95], 

there exists a proper holomorphic ?7'^-equivariant embedding of U'^ x*-^^ V into a holomorphic 
[/'^-representation space such that [e, 0] has minimal distance to 0. Then it follows from the 
definition of the gradient map that [e,0] G Mp- Moreover, G x*^"" 5" is G-locally closed in 
the holomorphic [/"^-representation. This shows that the slice neighborhood GS is a G-open 
neighborhood of x which admits the structure of a G-semistable space such that x S A^p. 

Moreover, we observe that a topological G-space X with topological Hilbert quotient vr : X — > 
X// G is a locally G-semistable space if and only if for each x (z X there exists a complex reductive 
group [/^ containing G as a compatible subgroup and a G-open neighborhood of x in X which 
is G-equivariantly homeomorphic to G x^ S where H is a compatible subgroup of G such that 
G n H = H and such that S is f[-locally closed in a holomorphic H -representation space V. 
Here the Zariski closure of H is taken in [/^. 

Example 2.9. Let X be a smooth G-manifold and assume that the action of G is proper. Then 
the topological Hilbert quotient coincides with the geometric quotient and at each x (z X there 
exists a slice G x^^ S — >■ GS where S is an open neighborhood of in a Ga;-representation 
space V by [Pa61]. The isotropy Gx is compact, so the G^-representation V extends to a (Gx)'^- 
representation V^. Then X is a locally G-semistable space since (G^)^ = G^ where the Zariski 
closure is taken in {Ug)'^- 

In a G-semistable space, a closed G-orbit intersects A4p in a unique X-orbit. In order to 
describe the intersection G ■ x D Xcc, we need the following two lemmas. 

Lemma 2.10. Let H be a compatible subgroup of G. Then the normalizer Mg{H) of H in G 
is compatible. 

Proof. The normalizer Mg{H) is invariant under the Cartan involution 9, so it suffices to show 
that is consists only of finitely many connected components. By [Po98], the group H ■ Zg{H), 
where Zg{H) denotes the centralizer of H in G, is of finite index in Mg{H). Let U'^ be a 
complex reductive group containing G as a compatible subgroup. Then Zg{H) = Zg{H ) = 
G n Z—z{H ). The centralizer Z—z{H ) is invariant under the Cartan involution 9 and it 
has only finitely many connected components since it is an algebraic group. Therefore it is 
compatible. Then Zg{H) is compatible since the intersection of two compatible subgroups is 
compatible. Thus H ■ Zg{H) consists of only finitely many connected components and the claim 
follows. □ 

Lemma 2.11. Let H be a compatible subgroup of G. Let g £ G. Then gHg^^ is compatible 
if and only if g £ K ■ J\fG{H). In particular, if gHg^^ is compatible, then gHg~^ and H are 
conjugate in K , so gHg~^ = kHk~^ for some k G K. 

Proof. Let H = Lexp(q) be the Cartan decomposition of H. Then for k £ K, we have kHk~^ = 
kLk~^ exp{Ad{k)q). Since the adjoint action of K stabilizes p, we conclude that kHk~^ is 
compatible. So for g £ K ■ Ng{H), the group gHg^^ is compatible. 

Conversely, if gHg~^ is compatible, we may assume g = exp(^) where ^ G p. The groups H and 
gHg~^ are 0-stable since they are compatible. Therefore gHg~^ = 9{gHg~^) = 9{g)H9{g~^). 
Explicitly, we have exp(^)i? exp(— ^) = exp(— exp(^) or equivalently exp(2^) G Ng{H)- 
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Since Ng{H) is compatible by Lemma 2.10 and since ^ E p, we conclude that ^ is contained in 
the Lie algebra of MciH) which implies g G MciH). □ 

It follows from Lemma 2.11 that for x G Xcc the orbit G ■ x intersects Xcc in K ■ Ng{Gx) ■ x. 
In particular, for y G ■ x Xcc the isotropy Gy is conjugate to Gx in K. 

3. Isotropy Stratification 

3.1. The Isotropy Stratification Theorem. Let X be a locally G-semistable space and let 
vr: X — > X//G be the topological Hilbert quotient. For a closed compatible subgroup H of G we 
define 

X<^> := {x e Xcc, Gx = H}. 
Note that we have a partition Xcc = U/z^^^^i where the union is taken over all compatible 
isotropy groups of points on closed orbits. We call the G-saturated set 

Ih{X) :=7r-i(7r(X<^>)) = {x e X; G^ Ci X<^> / 0} 

the G-isotropy stratum of H in X. In other words, Ih{X) consists of those fibers of vr, where 
the unique closed orbit is of orbit type G/ H. We abbreviate Ih{X) by Ih and call Ih a stratum, 
if no confusion is possible. 

Theorem 3.1 (Isotropy Stratification Theorem). Let X he a locally G-semistable space. Let I 
be an index set and let Hi, i ^Z, he compatible subgroups of G such that {Hi; i ^1} is a set of 
representatives of conjugacy classes of isotropy groups of closed G-orbits in X . Then 

(1) Lf{. is G-saturated and locally closed. 

(2) X = UiGl CLnd the union is disjoint and locally finite. 

(3) If Ljji n Ihj 7^ and 7^ luj then there exists a g G G with gHig~^ ^ Hj. 

Example 3.2. Consider the adjoint representation of a connected semisimple group G. There 
exist finitely many ^-stable Cartan subalgebras . . . , f}„ in the Lie algebra g of G such that 
each Cartan subalgebra is conjugate to one of these. A G-orbit in g is closed if and only if it 
intersects a Cartan subalgebra. If ^ € [)j is a regular element, then the isotropy equals the 
centralizer Hi := Zci^i) of \]i in G. Since a neighborhood of ^ in \]i is a slice for the G-action, 
we conclude that the strata Ih^, ■ ■ ■ , Ih„ are the open strata in g. 

In the special case where G is complex reductive, all Cartan subalgebras are conjugate to 
each other, hence there exists an open and dense stratum. 

3.2. The proof of Theorem 3.1. First note that is G-saturated by definition and that 
X is the union of the strata since each orbit contains a closed orbit in its closure and since 
each closed orbit intersects Xcc- The union is disjoint for if two strata Ih and Ih' intersect, the 
intersection contains a closed orbit, which implies that H and H' are conjugate in G. 

Locally the stratification is determined by the stratification of a slice. For this, let {Gx, S, V) 
be a slice model at x € Xcc- Since 5 is a G^-semistable space, we have the notion of G^-isotropy 
strata in S- Moreover, a G-orbit G • y with y G S is closed in X if and only if the Ga;-orbit Gx ■ y 
is closed in S- Note also that {Gx)y = Gy- Identifying GS with G x'^'^ S, we get 

lH{X)nGS = {jGx^- IhAS), 

for a compatible subgroup H of G. Here the union is taken over all subgroups Hi of Gx such 
that Hi is conjugate to H in G. In particular, we obtain Ig^{X) n GS = G ■ Ig^{S). The 
stratum Ig^{S) is given by the intersection of S with Ic^iV)- But the closed G^j-orbits in V 
with isotropy conjugate to Gx are the G^-fixed points V'^'^ and the orbits which contain a fixed 
point in their closure are orbits through points v &V which are the sum of a fixed point and an 
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element of the nullcone A/" := {f G F; G G^; • v}. This imphes Ig^{S) = S Ci (F*^^ where 
yGx _|__^ ._ _|_ G y*^^,f2 G A/"}. Since the nullcone is real algebraic in V (Lemma 7.1 

in [HS07a]), this shows that Ic^iS) is locally closed which in turn implies that /^^(X) is locally 
closed. 

We show that the stratification is locally finite. If X is a G-representation space, the strata are 
cones which by definition means that they are invariant under multiplication with positive real 
numbers. Then the stratification is locally finite at G X if and only if there exist only finitely 
many strata in X. An arbitrary locally G-semistable space is covered by slice neighborhoods and 
the strata in a slice neighborhood are determined by the strata in a slice. A slice is a subspace 
of a representation space, so local finiteness follows from 

Proposition 3.3. Assume X is a G -representation which is given by restriction of a holomor- 
phic U'^ -representation. Then there exist only finitely many strata in X. 

Proof. Since the representation is completely reducible (Lemma 2.5), we have an invariant de- 
composition X = W (B X^ . Replacing X by W ., we may assume X'~' = {0}. 

Recall that we have the notion of a gradient map and its zero fiber A^p on the G-semistable 
space X. The strata in X are determined by the orbit types of closed orbits in X and the closed 
orbits intersect Mp. But the strata as well as Aip are cones in X, so up to the nullcone Ig{X) 
every stratum intersects R Mp where is a sphere which is defined with respect to an 
arbitrary inner product. Therefore it suffices to show that Mp PIS'" intersects only finitely many 
strata. Let (G„, 5, V) be a slice model at v G Ampins'". Since the compact set A^pHS"" is covered 
by finitely many slice neighborhoods, it suffices to show that the slice neighborhood GS consists 
of only finitely many strata. But the G-isotropy strata in GS are determined by the G„-isotropy 
strata in S which in turn are determined by the G^-isotropy strata in the representation space V . 
Moreover G^ is a proper compatible subgroup of G since X^ = {0}. Therefore the proposition 
follows by induction over the dimension and the number of connected components of G. □ 

Remark. If G acts properly on y, then there exists an open and dense stratum in V . The proof 
is similar to that of Proposition 3.3. Since every G-orbit is closed, the nullcone is trivial and the 
sphere S*" can be covered by finitely many slice neighborhoods where each slice neighborhood 
contains a dense stratum by induction. If the dimension of V is greater than one, then the claim 
follows since 5" is connected. If the dimension of V equals one, then there is a dense stratum 
since the strata are cones. 

More generally, if X is a smooth G-manifold such that the G-action is proper and if the 
quotient X/G is connected, then there exists a dense stratum in X. 

It remains to show the last statement of Theorem 3.1. For this, let x G fl Ih^- Since 
the intersection is G-saturated, we may assume that G • x is closed and that Gx = Hj. Let 
{Hj,S,V) be a slice model at x. The slice neighborhood GS and are G-saturated, so GS 
intersects X^^"-^ . But this implies that Hi is conjugate to a subgroup of Hj. Thus the proof of 
Theorem 3.1 is completed. 

3.3. Strata and Slices. Let x G Xcc and let {Gx,S,V) be a slice model at x. We will give a 
criterion for which choice of Hi the stratum Ijif . (5) in S is non-empty in Lemma 3.5. For this, 
we first observe that locally the defining set X'^^^ of Ih{X) is determined by S'^^^ = {y G 
S; {Gx)y = H,Gx -y closed}. 

Lemma 3.4. Let {Gx,S,V) be a slice model at x ^ Xcc o-nd let H he a compatible subgroup of 
Gx- Then there exists an open MciH) -invariant neighborhood W of x in X which contains S 
such that 

(1) W n X<"> = Ng{H) ■ S<^> and 
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(2) w r\ = Mg{h) ■ . 

Proof. Let p: G x*^^ S —>■ G/Gx denote the projection p{[g,s]) = g ■ Gx- The set of iZ-fixed 
points in the homogeneous space G/Gx consists of isolated MG{H)-orhits. Therefore there exists 
an open A/G'(-ff)-invariant neighborhood W of e • Gx in G/Gx such that the H-&xed points in 
W' are given by MciH) ■ e ■ Gx- Defining W := p~^{W'), the claim follows from G-equivariance 
of p. □ 

In the rest of this paper we assume that every non-empty Gx-isotropy stratum in the slice S 
contains x in its closure. This can always be achieved by replacing S by an appropriate open 
neighborhood of x. More precisely, we remove the closures of the strata which do not contain 
X in their closure. By Proposition 3.3 this is only a finite number of strata. Then we choose 
a Gx-open neighborhood of x inside the so obtained G^j-invariant open neighborhood. This is 
possible by Corollary 2.3. 

Lemma 3.5. Let X be a locally G-semistable space, let x G Xcc and let {Gx,S,V) be a slice 
model at x. Then a Gx-isotropy stratum IniS) in S is non-empty if and only if x is contained 
in the closure X<^> of X<^> . 

Proof. First, if x € X<^> then S'^^^ is non-empty by Lemma 3.4 which implies that Ih{S) is 
non-empty. 

Recall that 5 is a Ga;-semistable space with gradient map fip^ : 5 — > pa^. Since x is a G^^-fixed 
point, the orbit Gx ■ x = x is closed and a fortiori x is contained in the zero-fiber Aip^ of /ip^. 
If Ih{S) is a non-empty stratum, we have x G Ih{S). Then x € Ih{S) n Mp^ by Corollary 2.2. 
Thus there exists a sequence x„ E IniS) n A^p^ which converges to x. The G^^-isotropy at Xn is 
compatible and conjugate to H. Therefore there exist kn G Kx with fc„x„ € S'^^^ C X^^^ by 
Lemma 2.11. But /cnX„, converges to the Er2;-fixed point x so we get x G X<^>. □ 

3.4. The splitting number. In this section we assume that X contains a dense stratum Ih- 
Let X G Xcc and let {Gx,S,V) be a slice model at x. Recall that we assume that every open 
G^-isotropy stratum contains x in its closure. We define n(x) to be the number of open G^;- 
isotropy strata in 5. For an arbitrary point y & X we define n{y) := n{x) where x is a point in 
the fiber 7r~^(7r(y)) of the quotient vr: X — > X//G which is contained in Xcc- We call n{y) the 
splitting number at y. 

The splitting number is well defined. In order to see that, let x,x' G 7r~^(7r(y)) n Xcc- Then 
x' = gx for a g £ G- If S" is a slice at x' then S := g~^S' is a slice at x and the map g~^ : S" — > S", 
s g~^s sets up a one to one correspondence between open strata in S' and open strata in S- 
The following proposition implies that n{x) does not depend on the choice of the slice at x. 

Proposition 3.6. Let X be a locally G-semistable space which contains a dense stratum Ih{X). 
Let [Gx^S^V) be a slice model at x £ Xcc- Then Ih'{S) is a non-empty open stratum in S if 
and only if kH'k~^ = H and kx G X<^> for a k G K- The union of the open strata is dense 
in S and coincides with Ih{X) D S. 

Proof. By Lemma 3.5 the stratum /^.-i^^.(5) is non-empty if and only if x G or 
equivalently kx G X<^>. 

Let Ih'{S) be any stratum in S which intersects Ih{X) fl S. Then H' is conjugate to H in 
G and we get Ih'{S) C Ih{X) n S. It follows from Theorem 3.1 (3) that Ih'{S) is closed in 
Ih{X) n S- The G^-isotropy stratification of V is finite by Proposition 3.3, which implies that 
every stratum in Ih{X)i^S is also open in S- In particular the union of the open strata coincides 
with the open and dense subset Ih{X) n S- 

Finally, a stratum I^'iS) is open if and only if it is contained in Ih{X) Pi S which is the case 
if and only if H' is conjugate to -ff in G and then also in K by Lemma 2.11. □ 
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For X € X^^^, the group kHk ^ is a subgroup of Gx = H if and only if € Nk{H). This 
imphes 

Corollary 3.7. Let X he a locally G-semistahle space which contains a dense stratum Ih{X). 
Then n{x) = 1 for all x ^ Ih- 

Example 3.8. By the remark following Proposition 3.3, the splitting number is constantly one 
if X is a smooth G-space such that G acts properly on X. 

If X is a complex space or a complex variety equipped with a regular action of a complex 
reductive group G, then it follows from Luna's Slice Theorem ([Lu73]) that a stratum is locally 
closed with respect to the Zariski topology. Then, if X is irreducible, there exists a dense stratum 
in X. In particular, if X is normal, it is irreducible at each point which implies n{x) = 1 for all 
xeX. 

4. The Restriction Theorem 

4.1. The Restriction Theorem. Let X be a locally G-semistable space containing a dense 
stratum Ih{X). Then X is a locally 7VG(-ff)-semistable space by Lemma 2.8 which in turn implies 
that the closed A/G'(-ff)-invariant subset X<^> of X is a locally A/G'(-ff)-semistable space. In 
particular the quotient ttn- X<^> X<^> //Mg{H) exists. 
We now state and prove our main result. 

Restriction Theorem. Let X be a locally G-semistable space containing a dense G-isotropy 
stratum Ih- Then the inclusion X<^> ^ X induces a continuous finite surjective map 

X<h>//Mg{H) ^ X//G. 

For X £ X, the number of points in the fiber <I>^^(7r(x)) is equal to the splitting number n{x). If 
x G X<^> with n{x) > 1, then $ is not open at tti\i{x). 

Here, by a finite map, we mean a proper map with finite fibers. 

Remark. If X is a smooth manifold which is covered by G-open sets which are diffeomorphic 
to G-locally closed submanifolds of holomorphic representation spaces, then is a closed 

submanifold of X. For the proof, we refer the reader to Section 5. 

Since a finite map is closed and a closed bijective map is open, we get 

Corollary 4.1. Assume that n[x) = 1 for all x £ X . Then ^ is a homeomorphism. 

For a locally G-semistable space X, a stratum Ih and the closure Ih are again locally G- 
semistable spaces. In particular, if X does not contain a dense stratum, we may apply the Re- 
striction Theorem for Ih- Moreover, for each stratum Ih-, the restriction <I>: X^^^ //Mg{II) —>■ 
Ih//G is a homeomorphism by Corollary 3.7. 

Example 4.2. $ is a homeomorphism in the situations considered in Example 3.8. 

If X is a smooth G-manifold such that the quotient X/G is connected and if the G-action is 
proper, then a dense stratum Ih always exists. In particular, if G is compact, the assertion of 
the Restriction Theorem is equivalent to a result in [SchSO]. 

For the action of a complex reductive group G on an irreducible normal complex affine va- 
riety X, a result similar to our Restriction Theorem was established in [LR79]. Here the map 
X^ //Mg{II) X//G is considered and it is assumed that X^ //Mg{H) is irreducible. How- 
ever, 

X<H> 

is a union of irreducible components of X^ so the quotients X^ //Mg{II) and 
X<^> // MciH) coincide under the additional assumption that X^ //J\fG{II) is irreducible. Due 
to normality of X, the map ^ is an isomorphism of affine varieties. 
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Example 4.3. Let n > 2, G := SL2n(M) and consider the natural action of J := SO(n,n) on 
V := M^". Defining X := G x-^ V , a G-orbit G • [g,v] in X is closed if and only if the J-orbit 
J ■ V is closed in V. Computations show that each closed J-orbit in V intersects one of the 
rays h := • (ei,0) and £2 ■= • (0,ei). In this notation we identify R^n and M" x M". 
Therefore the quotient X//G is homeomorphic to ii U £2 which is homeomorphic to M. 

Let Hi := J(ei,o) ^iid H2 := J{o,ei)- The J-representation V consists of three strata, namely 
the nullcone Ij{V) and the open strata iHiiV) = {{vi,'V2) € V; \\vi\\ > \\v2\\} and Ih^^V) = 
{{vi,V2) € V; \\vi\\ < \\v2\\}- In particular, the splitting number at [e, 0] equals 2. The groups Hi 

and H2 are conjugate in K. Explicitly we have Hi = A;o-ff2^(7^ for ^0 ~ j 0^ ^ ' ^^^^^^S 

H := Hi, we conclude that the stratum Ih{X) = Ih2{^) is dense in X and we may apply the 
Restriction Theorem. We get 



X<H> = {[g,v]; g € Ng{H),v G h] U {[gk^M^ 9 G ^fG{H),v G £2}. 



Then the quotient X<^> //MciH) is homeomorphic to {[e, f]; v G £1} U {[A;o,f]; v G £2}, which 
is homeomorphic to the disjoint union of two rays. With respect to these identifications, the 
map $ is given by $([e, f]) = v fov v G £1 and $([/co, f]) = v ioi v G £2- We observe that $ glues 
the two rays at their boundary points. 

4.2. The proof of the Restriction Theorem. First note that we may assume that X is a 
G-semistable space. Then the quotient X//G is homeomorphic to AA^/K where Mp is the zero 
fiber of the gradient map ^p: X ^ p. Moreover the quotient X'^^^ // MciH) is homeomorphic 
to Ain^/MxiH). Here rip denotes the intersection of p with the Lie algebra oi Mg{H) and A4np 
is the zero fiber of the A/G'(-ff)-gradient map /inp : X<^> — s- np. 

The following lemma shows in particular that A^ttp is contained in Aip which implies that the 
map $ corresponds to a map 0: Ainp /J^k{H) Aip/K such that the diagram 

MnJMK{H)^^Mp/K 



X<h>//Mg{H)^^X//G 



commutes. 



Lemma 4.4. We have M^^ = X<^> n Mp. 



Proof. Since rip is a subspace of p, the inclusion X<^> n A^p C J^np follows from the definition 
of the gradient map. 

We show X<^> n Mnp = X<^> n Mp. For this let x G X<^> n Mn^- Since G ■ x is 
closed, we have gx ^ Mp for some g £ G. The isotropy groups Gx = H and Ggx = gHg~^ 
are compatible, which yields g = kh £ K ■ MciH) by Lemma 2.11. The ET-invariance of Mp 
implies hx G Mp C Mn^- But then h • x £ Mk{H) ■ x since Mg{H) ■ x intersects Mnp in a 
unique A/}^(iJ)-orbit. Thus x G A^p follows from the ii'-invariance of Mp. With Corollary 2.2 
we conclude Mnp = X<h> n M„^ C X<h> r\Mp. □ 

Surjectivity of (j) and then also of <I> follows from 

Lemma 4.5. We have Mp = K ■ Mnp ■ In particular Mp C K ■ X<^> . 

Proof. The inclusion K ■ Mnp C Mp follows from X-invariance of A^p and Lemma 4.4. 
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For X € A^pfl///, the isotropy group Gx is compatible and conjugate to H. Then it is conjugate 
to if in K by Lemma 2.11. This shows MpHlH = K ■ [Mp n X<^>) and Mp n In C K ■ M^^ 
fohows from Lemma 4.4. 

We claim that A^pfl/// is dense in Mp. Then the assertion of the lemma follows since K-M.^^ 
is closed. If this is not the case, then there exist an x G Mp and an open neighborhood W oi x 
in Mp which does not intersect Ih- Recall that the restriction vr: Mp X//G of the topological 
Hilbert quotient is open. Therefore 7r~^(7r(VF)) is a G-open neighborhood of x in X which does 
not intersect Ih- This is a contradiction, since Ih is dense in X. So A^p n/j^ is dense in Mp. □ 

For X G Mn^ the number of points in the fiber (j)~^{'K{x)) equals the number of TVi^ (ii)-orbits 
in • X n Mnf Here we describe the 1-1-correspondence between these orbits and the open 
Gaj-isotropy strata in a slice at x explicitly. As a consequence we see that the number of points 
in the fiber (^~^(7r(x)) is equal to the splitting number nix). 

Proposition 4.6. Let x S Mn^ and let {Gx, S, V) be a slice model at x. Then 

^: {K ■ X n Mn^) /Mk{II) {Non-empty open Gx-isotropy strata in S}, 
Mk{II) ■ k ■ X ^ Ik-iHk{S) 
is well-defined and bijective. 

Proof. First, we show that ^ is well-defined. For kx E M„^ C X<^>, the stratum Ii.-iHk{S) is 
non-empty and open by Proposition 3.6. Assume that MK{H)-kix = AfK{II)-k2X C K-xriX<^> 
with ki,k2 € K. This is equivalent to ki G Mk{II) ■ ^2 ■ Kx which in turn is equivalent to the 
condition that k^^Hki and k2^Hk2 are conjugate in Kx- But then k^^Hki and k2^Hk2 define 
the same G^-isotropy stratum in S. 

For injectivity, assume ^(AfKiH) - kix) = ^{AfKiH) ■ k2x). Then I^-inkS^^ ^ h-^Hk2^^) 
and the compatible groups k^^Hki and A;^^F/c2 are conjugate in Gx. By Lemma 2.11 they are 
conjugate in Kx- Thus we get MxiH) ■ kix = Nk{II) • ^22;- 

It remains to show that ^ is surjective. By Proposition 3.6 a non-empty open stratum is of 
the form I^-ijjkiS) for some k £ K with kx G Then kx G Mnf, by Lemma 4.4 and 

surjectivity is proved. □ 

The inclusion Mn^ ^ Mp is continuous and proper. Since Mk^H) and K are compact, this 
implies that (p is continuous and proper. Hence, cj) is finite. 

To prove the last assertion of the Restriction Theorem let x,y £ Mn^/NxiH) with x ^ y 
and 4){x) = 4>{y). Let Wx and Wy be open neighborhoods of x and y, respectively, such that 
Wx n Wy = 0. Assume that (j) is open at x. Since Mn^ nX^^-^ is dense in Mn^ by Corollary 2.2, 
there exists a z G Wy^^{X<^>r\Mn^)/NK{II) satisfying G (l){Wx). But then (/>(2;) G (l){Wx)r\ 
4>{Wy), which is impossible since the restriction 4>: n M^^) / Mk{II) {Ih n Mp)/K is 

injective by Corollary 4.1. 



5. Smoothness of X<^> 

We assume that X is a smooth locally G-semistable space and that Ih is a dense stratum in 
X. The purpose of this section is to show that then X<^> is smooth. 

Theorem 5.1. Assume X is a smooth locally G-semistable space containing a dense stratum 
Ih{X). Then the closure X<^> of X^^^ is open and closed in the fixed point set X^ . In 
particular, X<^> is a closed submanifold of X. 
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Proof. First, we reduce the assertion of the theorem to the case, where X is a G-representation 
space. Assuming that X is a G-semistable space, the quotient X<^> // Mg{H) is homeomorphic 
to Mn^/MK{H). Moreover, we have M^^ C Mp by Lemma 4.4. Since X<^> and are 
A/G'(-ff)-invariant, it therefore suffices to show that is open in X^ at a point x G X<^> D 

Mp. Let {Gx, S, V) be a shce model at x. Locally near x, we have X^^-^ = Mg{H) ■ S^^^ and 
X" = Mg{H) ■ by Lemma 3.4. Then it suffices to show that V<H> = 

since S is an open 

neighborhood of in V . 

By [St09] there exists a subset lA of which is open with respect to the real algebraic Zariski 
topology such that Gx • v Is closed for v ^U. Furthermore, the set O := G dimG^, • v > 
dimGx/H} is Zariski open in V^. The intersection UnO contains V<"> = Ih{V) n . If 
Y<H> jg j^Q^ dense in , there exists a stratum Ih'{V) such that the intersection lHi{V)nUr]0 
contains an interior point vq in . Conjugating H' if necessary, we may assume that H' contains 
H as an open subgroup. By Proposition 3.6, it now suffices to show that In'i^) is open in V. 

Let (i/',5o,VFo) be a slice model at vq and let {H, Si,Wi) be a slice model at vi G V^^^ . 
Then Wq and Wi are equivalent as i?-representation spaces since V = Ti,g{G • vq) ® Wq = 
Ty-^ (G • f 1 ) © Wi are //-invariant decompositions of V and since since T^,^ {G-vq) and T^,^ {G-vi) are 
equivalent //-representations. Define W := Wq = Wi. We have W = +J\f where J\f is the H- 
nullcone in W since Iniy) is open. For openness of Ih'{V) we must show W = +J\f' where 
M' is the //'-nullcone. But we have M = M' since H is open in H' . Since vq is an interior point 
of Ih' (V) n in V^, there exists a neighborhood D oiOinW such that D n C W^' +M. 
By algebraicity we get C W^' + J\f. But this implies W = + M = W^' + N' and the 
proof is completed. □ 
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